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Abstract 

We  investigate  the  reliability  of  a  semi-automated  sys¬ 
tem  designed  to  locate  the  Maltese  front  from  satellite 
AVHRR  and  SAR  imagery \  The  opening  and  closing  op¬ 
erations  of  mathematical  morphology  afford  a  means  of 
image  segmentation  that  provides  smooth,  strong,  con¬ 
tinuous  edges  except  where  the  edges  are  obscured  by 
clouds  or  similar  phenomena.  We  evaluate  the  results  by 
comparing  them  with  front  positions  found  by- 
experienced  Navy  analysts.  Our  system  provides  an 
objective  method  for  front  location  that  is  less  labor- 
intensive  than  manual  methods  currently  in  use. 


1.  Introduction 

Oceanic  temperature  fronts  occur  where  warm  and 
cold  water  meet.  Differences  in  water  temperature, 
salinity,  density,  and  sea  surface  roughness  show  the 
presence  of  a  temperature  front.  This  work  uses  sea 
surface  temperature  differences  and  sea  surface  roughness 
to  locate  die  surface  position  of  the  Maltese  front,  a 
boundary  separating  two  water  areas  near  Sicily  and 
Malta  that  differ  in  temperature  by  at  most  1.0-1.5°C. 

The  Maltese  front’s  position  varies  daily  and  season¬ 
ally.  During  colder  months,  it  is  oriented  north-south  and 
located  east  of  Malta  and  Sicily;  in  warmer  months,  it  is 
oriented  east-west,  and  located  between  Sicily  and  Malta. 
In  winter,  the  temperature  difference  between  the  two 
water  masses  may  be  less  than  0.5°C,  and  the  front’s  posi¬ 
tion  may  not  be  well-defined  in  sea  surface  temperature 
images.  The  location  of  the  front  is  of  interest  to 
oceanographers  for  the  information  it  provides  about 
water  motion  in  the  Mediterranean  Sea. 

This  work’s  purpose  was  to  investigate  the  reliability  of 
a  semi-automated  system  designed  to  locate  the  front. 
Presently,  Navy  analysts  manually  mark  the  front’s  daily 
position  as  a  set  of  10-20  geographical  points,  which  can 
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be  interpolated  by  various  types  of  curves.  The  operation 
is  labor-intensive,  subjective  and  dependent  on  the  skill  of 
the  analyst.- 

Our  semi-automated  system  uses  mathematical  mor¬ 
phology  to  find  the  surface  position  of  the  front,  and 
offers  the  operator  a  choice  among  a  few  of  the  most 
likely  front  positions.  The  system  grew  out  of  previous 
work  on  finding  the  position  of  the  Gulf  Stream  and 
associated  rings  [1,  2],  which  was  successfully  extended 
to  the  much  weaker  Maltese  front. 

2.  Images 

Fronts  are  three-dimensional  phenomena.  Satellite 
sensors  provide  only  two-dimensional  information, 
although  altimeter  data  indirectly  provides  information 
about  subsurface  structure.  Oceanographers  modeling  a 
front  match  a  feature  model  to  the  satellite  data  at  the 
surface  and  infer  subsurface  features  from  model 
predictions  [3,  4,  5]. 

The  sea  surface  temperature  (SST)  images  used  in  this 
study  are  products  of  the  NOAA-11  satellite's  AVHRR 
(Advanced  Very  High  Resolution  Radiometer).  The  data 
from  two  AVHRR  channels  is  combined  to  calculate  a  sea 
surface  temperature  (intensity)  in  °C  to  the  closest  0.1  °C; 
the  accuracy  of  the  temperatures  is  0.5  to  1.0°C  [6]. 

Synthetic  aperture  radar  (SAR)  images  from  the  ERS-1 
satellite  provide  information  on  sea  surface  roughness. 
High-intensity  areas  in  SAR  images  correspond  to  areas 
that  reflect  radar  well,  which  are  qualitatively  rougher 
than  surrounding  (lower-intensity)  smooth  areas. 

3.  Analysis  and  results 

In  both  sets  of  images,  the  front  boundary  corresponds 
to  an  edge  separating  two  water  masses  with  different  in¬ 
tensity  values.  Finding  the  location  of  the  front  requires 
finding  the  largest  temperature  value  (7})  or  roughness 
value  (R/)  corresponding  to  pixels  on  the  cold  or  less 


rough  side  of  the  front.  The  system  then  smoothes  the 
temperature  or  roughness  values  in  the  image  and  zeroes 
all  pixels  with  temperature  or  roughness  less  than  or 
equal  to  7}  ( R !/).  The  boundary  between  zero  and  nonzero 
pixels  represents  the  desired  front  location. 

Since  the  images  are  1  byte/pixel  images,  the  semi- 
automated  system  (or  human  analyst)  initially  has  256 
choices  for  7}.  The  system  is  designed  to  use  image  in¬ 
formation  to  reduce  the  number  of  choices  to  one  or  a  few. 
among  which  is  the  correct  value. 

Mathematical  morphology  [7,  8,  9]  has  been  used  suc¬ 
cessfully  to  find  front  positions  in  ocean  images  [1.  2], 
The  opening  and  closing  operations  of  mathematical  mor¬ 
phology,  based  on  the  familiar  dilation  and  erosion  op¬ 
erators,  perform  intensity  smoothing  that  results  in 
smoothing  of  edges.  Consequently,  these  operators  are  an 
excellent  choice  for  image  segmentation  where  edges  are 
ultimately  to  be  found;  they  provide  smooth,  strong,  con¬ 
tinuous  edges  except  where  the  edges  are  obscured  by 
clouds  or  similar  phenomena. 

3.1.  SST  images 

We  used  49  SST  images  of  the  Mediterranean  Sea.  ac¬ 
quired  between  March  and  September  1993,  in  construct¬ 
ing  the  semi-automated  system.  These  images  are 
2048x1024x16  bits,  covering  the  entire  Mediterranean 
Sea  (29.6°-42.0°  North  latitude,  7.0°-37.7°  East  longi¬ 
tude).  Preprocessing  extracted  the  Sicily-Malta  area 
(34.04°-37.16°  North  latitude,  13.36°-17.18°  East  longi¬ 
tude)  and  the  temperature  range  considered  (7.5°C- 
33.0°C)  while  preserving  the  original  temperature  resolu¬ 
tion.  This  range  includes  all  surface  water  temperatures 
likely  to  be  observed  in  the  Sicily-Malta  area  of  the 
Mediterranean  Sea. 

The  semi-automated  system  uses  three  image  parame¬ 
ters,  predicted  mean  temperature  Tp ,  image  quality  Q,  and 
predicted  maximum  front  temperature  7},  calculated  from 
image  statistics:  temperature  minimum,  maximum,  mean, 
and  standard  deviation  (o). 

A  good  fit  to  the  mean  temperatures  of  the  49  images 
is  provided  by  a  single  frequency  sinusoid  (Fig.  1), 

TP  =  134.07  -  70.71  sin  (2nd  -  36.68)7365 )y  (1) 

where  d  is  the  ordinal  number  of  the  day  in  the  year.  The 
curve  parameters  are  derived  from  a  least-squares  fit  to 
the  means  of  the  25  best  images,  selected  based  on  visual 
observation  and  the  hypothesis  that  good  images  have 
higher  means  than  poor  images  (those  with  clouds  or 
missing  data)  of  close  to  the  same  date.  The  x2  value  for 
the  fit  is  3.00  for  22  degrees  of  freedom.  Maximum  and 
minimum  values  occur  respectively  on  August  25  and 


February  24;  these  values  agree  well  with  seasonal  lag 
and  the  ocean  surface  water  minimum  and  maximum 
temperature  dates  [10].  Eq.  (1)  does  not  necessarily 
predict  water  temperature;  cold  clouds  may  unduly  bias 
March  data,  and  hot  land  September  data. 


Figure  1.  Mean  temperature  for  SST  images 
(after  preprocessing)  as  a  function  of  day  in 
the  year.  The  curve  is  a  single  frequency 
sinusoid  fit  to  the  means  of  the  25  best 
images. 

Clouds  covering  the  front  indicate  a  poor  quality  im¬ 
age:  they  lower  the  mean  temperature  below  the  predicted 
mean  and  cause  an  extended  low-temperature  tail  in  the 
image  histogram.  A  combination  of  these  effects  was  se¬ 
lected  to  define  image  quality: 

Q  =  (\TP  -  Tmeait\  +  a)  /  Tmean.  (2) 

A  good  image  has  Q  <  0.5,  a  value  selected  based  on  vis¬ 
ual  observation  of  image  quality. 

We  also  used  visual  inspection  to  find  a  predicted  7} 
value.  We  found  values  for  good  and  poor  images  and 
made  separate  least-squares  fits.  The  fits  are  not  out¬ 
standing,  particularly  in  good  images,  where  outlying 
points  affect  the  x2  value  excessively,  but  they  provide  a 
reasonable  starting  point  for  the  system.  The  fits  used 
are: 

Tf  =  0.95  Tmean  +  0.13  (Tp  -  Tm<an)  -  0.42  (good) 
Tf  =  0. 72  Tmean  +  0.77  o  +  4.7  (poor). 

The  x2  values  are  respectively  7.06  (good,  35  degrees  of 
freedom)  and  0.06  (poor,  12  degrees  of  freedom).  Good 


images  have  7}  <  Tmean,  whereas  poor  images  have  7}  > 

Tmean  - 

Parameters  required  by  mathematical  morphology  are 
a  structuring  element  size,  selected  as  3  x  3,  and  a 
starting  threshold,  selected  as  min  (Tf  -  2 A,  Tm«m  -  1.0)  in 
°C,  though  it  may  be  any  value  lower  than  7}.  Once  the 
parameters  are  specified,  the  opening  and  closing 
operations  are  performed  at  threshold  intensities 
increasing  by  1  each  iteration,  and  the  number  of  image 
pixels  that  change  classification  from  background  to 
object  or  vice  versa  is  found  for  each  iteration.  An  edge 
corresponds  to  a  threshold  value  where  the  fewest  pixels 
change  classification,  that  is,  to  a  sudden  intensity  jump. 

The  number  of  pixels  changing  classification  fluctuates 
rapidly  from  one  intensity  value  to  the  next.  We  use  a 
sliding  window  to  accumulate  total  changes  in  bin  sizes  of 
3  (0.3°C  intensity  edge)  through  5  (0.5°C  edge)  intensity 
values.  We  then  combine  overlapping  minima  and  add  a 
bin  that  starts  on  the  correct  side  of  the  mean  (according 
to  the  image  quality  prediction)  and  ends  at  the  mean. 
The  identification  of  bins  containing  minima  continues 
until  either  at  least  two  bins  are  found,  with  one  that 
contains  the  7}  value,  or  minima  with  bin  size  3  are 
exhausted.  The  temperature  corresponding  to  the 
minimum  number  of  changes  in  a  bin  is  chosen  as  the  T 
value  for  that  bin. 

Our  semi-automated  system  sorts  bins  found  based  on 
the  likelihood  that  each  minimum  contains  the  front, 
using  the  following  criteria: 

(1)  A  minimum  on  the  incorrect  side  of  the  mean  (as 
judged  by  image  quality)  cannot  be  the  actual 
front  and  is  eliminated. 

(2)  The  bin  (if  any)  that  contains  the  predicted  7} 
value  is  the  most  likely  one  to  contain  the  front 
and  is  listed  first.  If  the  predicted  7}  value  is  not 
in  any  bin,  a  bin  extending  from  the  minimum 
below  the  predicted  value  to  the  minimum  above 
it  is  added,  with  the  predicted  value  as  the  T 
value  for  the  bin. 

(3)  Larger  bins  (temperature  differences)  are  more 
likely  to  be  the  actual  front  than  smaller  bins. 

(4)  Bins  closer  to  the  predicted  7}  value  are  preferred 
to  those  further  from  it. 

The  bins  found  are  identical  to  those  selected  by  a  hu¬ 
man  analyst.  On  the  average,  2.9  bins  are  found  for  each 
image;  the  smallest  number  found  is  1,  and  the  largest,  6. 

The  system  displays  the  original  image  and  up  to  5 
segmented  images: 

(1)  If  the  predicted  7}  value  is  in  a  bin,  the  T  values 
for  the  first  four  bins  found  are  sorted  in  order  of 
likelihood  and  displayed.  If  the  system  finds 
fewer  than  four  bins,  it  displays  fewer. 


(2)  If  the  predicted  7}  value  is  not  in  a  bin,  the  T 
values  for  the  first  three  bins  found  are  sorted  in 
order  of  likelihood  and  are  displayed  with  the 
predicted  value.  If  the  system  finds  fewer  than 
three  bins,  it  displays  fewer. 

The  user  may  choose  to  accept  a  displayed  image  as 
accurately  locating  the  front  (and  save  it),  to  explore  other 
possible  T  values  in  a  bin,  or  to  select  an  arbitrary  7}  value 
and  segment  using  it,  causing  display  of  a  fifth  segmented 
image. 

The  four  or  fewer  segmented  images  chosen  for  display 
contain  the  observed  7}  value  for  48  of  the  49  test  images 
(98%).  The  exception  is  a  poor-quality  image  for  which 
the  predicted  7}  value  is  quite  uncertain  and  where  no 
value  gives  a  reasonable  location  for  the  Maltese  front. 
The  observed  7}  value  is  the  program's  first  choice  for 
only  31  of  the  49  images  (63%),  but  since  it  is  a  semi- 
automated  system  it  has  the  advantage  that  the  operator 
can  overrule  it  when  necessary,  while  the  program  does 
most  of  the  work  in  finding  the  front. 


Figure  2.  30  July  1993  SST  image  of  the 
Maltese  front  area  with  fronts  found  using 
mathematical  morphology  (solid  line)  and 
NAVOCEANO  daily  analysis  (dashed  line) 
superimposed.  The  grid  is  East  longitude 
and  North  latitude. 


The  quality  of  the  resulting  front  positions  is  judged  by 
comparison  with  the  front  position  found  by  experienced 
Navy  analysts.  Fig.  2  shows  the  semi-automated  and  hu¬ 
man-analyst  fronts  superimposed  on  an  original  SST  im¬ 
age.  Error  is  estimated  by  finding  the  area  between  the 


fronts  and  dividing  the  are  by  the  arclength  of  the  human- 
defined  front,  giving  a  mean  error  in  front  position 
expressed  in  km.  The  mean  error  for  the  49  images  is 
10.05  km,  with  standard  deviation  5.40  km  and  range 
4.02  km  to  28.64  km  [11]. 

3.2.  SAR  images 

We  used  six  SAR  images  of  the  Mediterranean  Sea,  ac¬ 
quired  between  March  an  September  1993,  to  compare 
front  location  using  temperature  with  front  location  using 
sea  surface  roughness.  These  images  are  approximately 
8000x8000x16  bits,  covering  the  area  where  the  Maltese 
front  is  located.  The  images  were  made  on  dates  close  to 
those  of  six  SST  images.  Preprocessing  averaged  neigh¬ 
borhoods  of  8x8  pixels  to  reduce  variations  in  roughness 
caused  by  waves,  rotated  the  images  to  geographical  coor¬ 
dinates,  and  removed  the  gradient  caused  by  variable  de¬ 
tector  distances  by  dividing  by  a  gradient  image. 
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Figure  3.  30  July  1993  SAR  image  of  the 
Maltese  front  area  with  fronts  found  using 
mathematical  morphology  (solid  line)  and 
NAVOCEANO  daily  analysis  (dashed  line) 
superimposed.  The  grid  is  East  longitude 
and  North  latitude. 


Fronts  in  SAR  images  appear  as  transitions  from  low 
to  high  surface  roughness.  Both  temperature  and  wind 
fronts  are  evident  in  the  images;  wind  fronts  are  better 
defined  (sharper)  than  temperature  fronts.  We  used 
mathematical  morphology  to  extract  front  positions  in 
these  images  as  well.  For  the  SAR  images,  since 


temperature  fronts  are  noisier  than  wind  fronts,  the  most 
likely  roughness  Rf  (corresponding  to  7}  in  SST  images) 
occurs  when  the  most  pixels  are  changing  classification. 
There  is  a  single  clear  maximum  in  each  SAR  image 
tested,  with  a  value  of  R/  that  yields  a  front  position 
agreeing  moderately  well  with  that  found  by  the  human 
analyst  in  SST  images.  Unfortunately,  wind  fronts  (when 
present)  have  Rf  values  less  than  the  Rf  for  the 
temperature  front,  and  are  found  also.  The  human  analyst 
must  distinguish  the  two. 

Fig.  3  shows  the  semi-automated  and  human-analyst 
fronts  superimposed  on  an  original  SAR  image.  The 
roughness  and  temperature  positions  are  close  but  not 
identical.  Wind  may  affect  the  roughness  front  position. 
(Note  that  Fig.  3  and  Fig.  2  use  different  scales.)  Fig.  4 
shows  the  semi-automated  fronts  from  SST  and  SAR  im¬ 
ages  of  the  same  date,  and  the  front  located  by  the  human 
analyst,  superimposed  on  an  original  SST  image. 


Figure  4.  30  July  1993  SST  image  of  the 
Maltese  front  area  with  fronts  found  using 
mathematical  morphology  from  SST  image 
(solid  line)  and  from  SAR  image  (dash- 
dotted  line),  and  front  from  NAOVOCEANO 
daily  analysis  (dashed  line)  superimposed. 
The  grid  is  East  longitude  and  North 
latitude. 


4.  Conclusions 


The  semi-automated  system  produces  Maltese  front 
surface  positions  that  agree  well  with  those  found  by 
experienced  human  analysts  in  48  of  49  test  images 


(98%).  It  takes  advantage  of  simple  image  statistics  to 
produce  2  to  4  candidate  front  positions  rapidly,  allowing 
the  operator  to  use  experience  with  the  front's  surface 
position  at  various  times  of  the  year  to  select  die  best 
candidate  from  among  those  offered,  or  to  overrule  the 
system  and  select  a  position  based  entirely  on  experience. 
Our  system  provides  an  objective  method  of  locating 
fronts  that  is  less  labor-intensive  than  manual  methods 
currently  in  use. 
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Figure  2:  July  30,  1993,  SST  image  of  the  Maltese  front 
area  with  fronts  found  using  mathematical  morphology 
(solid  line)  and  NAVOCEANO  daily  analysis  (dashed  line) 
superimposed.  The  grid  is  East  longitude  and  North  lati¬ 
tude. 


Figure  3:  July  30,  1993,  SAR  image  of  the  Maltese  front 
area  with  fronts  found  using  mathematical  morphology 
(solid  line)  and  NAVOCEANO  daily  analysis  (dashed  line) 
superimposed.  The  grid  is  East  longitude  and  North  lati¬ 
tude. 


3.2  SAR  images 

We  used  six  SAR  images  of  the  Mediterranean  Sea,  ac¬ 
quired  between  March  and  September  1993,  to  compare 
front  location  using  temperature  with  front  location  us¬ 
ing  sea  surface  roughness.  These  images  are  approxi¬ 
mately  8000  x  8000  x  16  bits,  covering  the  area  where 
the  Maltese  front  is  located.  The  images  were  made  on 
dates  close  to  those  of  six  SST  images.  Preprocessing 
averaged  neighborhoods  of  8  x  8  pixels  to  reduce  varia¬ 
tions  in  roughness  caused  by  waves,  rotated  the  images 
to  geographical  coordinates,  and  removed  the  gradient 
caused  by  variable  detector  distances  by  dividing  by  a 
gradient  image. 

Fronts  in  SAR  images  appear  as  transitions  from 
low  to  high  surface  roughness.  Both  temperature  and 
wind  fronts  are  evident  in  the  images;  wind  fronts  are 
better  defined  (sharper)  than  temperature  fronts.  We 
used  mathematical  morphology  to  extract  front  posi¬ 
tions  in  these  images  as  well.  For  the  SAR  images, 
since  temperature  fronts  are  noisier  than  wind  fronts, 
the  most  likely  roughness  Rf  (corresponding  to  Tf  in 
SST  images)  occurs  when  the  most  pixels  are  chang¬ 
ing  classification.  There  is  a  single  clear  maximum  in 
each  SAR  image  tested,  with  a  value  of  Rf  that  yields  a 
front  position  agreeing  moderately  well  with  that  found 
by  the  human  analyst  in  SST  images.  Unfortunately, 


wind  fronts  (when  present)  have  Rf  values  less  than 
the  Rf  for  the  temperature  front,  and  are  found  also. 
The  human  analyst  must  distinguish  the  two. 

Fig.  3  shows  the  semi-automated  and  human  an¬ 
alyst  fronts  superimposed  on  an  original  SAR  image. 
The  roughness  and  temperature  positions  are  close  but 
not  identical.  Wind  may  affect  the  roughness  front 
position.  (Note  that  Fig.  3  and  Fig.  2  use  differ¬ 
ent  scales.)  Fig.  4  shows  the  semi-automated  fronts 
from  SST  and  SAR  images  of  the  same  date,  and  the 
front  located  by  the  human  analyst,  superimposed  on 
an  original  SST  image. 

4  Conclusions 

The  semi-automated  system  produces  Maltese  front 
surface  positions  that  agree  well  with  those  found  by 
experienced  human  analysts  in  48  of  49  test  images 
(98%).  It  takes  advantage  of  simple  image  statistics  to 
produce  2  to  4  candidate  front  positions  rapidly,  allow¬ 
ing  the  operator  to  use  experience  with  the  front’s  sur¬ 
face  position  at  various  times  of  the  year  to  select  the 
best  candidate  from  among  those  offered,  or  to  overrule 
the  system  and  select  a  position  based  entirely  on  ex¬ 
perience.  Our  system  provides  an  objective  method  of 
locating  fronts  that  is  less  labor-intensive  than  manual 


Figure  4:  July  30,  1993,  SST  image  of  the  Maltese  front 
area  with  fronts  found  using  mathematical  morphology 
from  SST  image  (solid  line)  and  from  SAR  image  (dash- 
dotted  line),  and  front  from  NAOVOCEANO  daily  analy¬ 
sis  (dashed  line)  superimposed.  The  grid  is  East  longitude 
and  North  latitude. 

methods  currently  in  use. 
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